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Abstract: 

PROBLEM TO BE SOLVED: To provide a method by which a code amount is assigned more properly between picture 
types even when an object average bit rate is closer to a maximum transfer rate in a variable bit rate control method 
adopting a 1-path or 2-path method for a dynamic image coder. SOLUTION: The dynamic image coder encoding a 
dynamic image is provided with a means 23 that detects a code quantity generated from the dynamic image, a means 
22 that detects a mean quantization scale of the dynamic image, a means 25 that detects a coding image characteristic 
of at least the dynamic image in the dynamic image and a motion compensation prediction image generated by a 
motion compensation prediction means, a 1st code quantity control means 51 that calculates a 1st assignment code 
quantity of the image to be coded next on the basis of the generated code quantity and the average quantization scale, 
a 2nd code quantity control means 52 that calculates a 2nd assigned code quantity placing a limit onto the 1st assigned 
code quantity and a means 51 that decides the quantization scale of the image to be coded next on the basis of the 1st 
and 2nd assigned code quantities. 



mhtml:http://ipportal.thomnet.com/patent/home/Patent Families Documents/PU/PU04xxx/P... 9/9/201 1 



PatentOrder MT 

i 



Page 2 of 16 




JPO Machine translation abstract: 
(57) Abstract 

SUBJECT High efficiency coding of video is started, and when performing variable bit rate encoding especially, it is 
related with a suitable code quantity controller. 

Means for SolutionA means 23 to detect a generated code amount of said video in video coding equipment which 
codes video, A means 22 to detect a normal child-ized scale of said video, and a means 25 to detect the coded image 
characteristic of said video at least among motion-compensation-prediction pictures generated by said video and said 
motion-compensation-prediction means, The 1st code-quantity-control means 51 that computes the 1st amount of 
allocation codes of a picture coded next from said generated code amount and a normal child-ized scale, It had a 
means 51 to determine the 2nd code-quantity-control means 52 that computes the 2nd amount of allocation codes that 
adds restriction to said 1st amount of allocation codes, and a quantizing scale of a picture coded from the said 1st and 
2nd amounts of allocation codes to said next. 



Claim(s) 

Claim IVideo coding equipment which codes an input moving image image by motion-compensation-prediction means, 
orthogonal transformation means, quantization means, and a variable-length-coding means, comprising: 
A means to detect a generated code amount of each picture of said input moving image image. 
A means to detect a normal child-ized scale of each picture of said input moving image image. 
A means to detect the coded image characteristic of said input moving image image at least among motion- 
compensation-prediction pictures generated by said input moving image image and said motion-compensation- 
prediction means. 

The 1st code-quantity-control means that computes the 1st amount of allocation codes of a picture coded next from a 
normal child-ized scale detected by generated code amount detected by a means to detect said generated code 
amount, and a means to detect said normal child-ized scale. 

The 2nd code-quantity-control means that computes the 2nd amount of allocation codes for adding restriction to said 
1st amount of allocation codes. 

A means to determine a quantizing scale of a picture coded to said next from the amount of allocation codes computed 
by the said 1st and 2nd code-quantity-control means. 

Claim 2In video coding equipment indicated to Claim 1, said 2nd amount of allocation codes, a picture type (I picture, 
P picture, B picture) — a maximum of the amount of allocation codes being computed independently, and, When 
determining the actual amount of allocation codes in said 1st code-quantity-control means, Video coding equipment 
determining the 2nd amount of allocation codes when said 1st computed amount of allocation codes exceeds a 
maximum of the amount of allocation codes set up in said 2nd amount of allocation codes, and determining said 1st 
amount of allocation codes as a actual amount of allocation codes when other. 

Claim 3Video coding equipment, wherein said 2nd code-quantity-control means is a code amount control method of a 
fixed bit rate in video coding equipment indicated to Claim 1 or Claim 2 and said 1st code-quantity-control means is a 
code amount control method of a Variable Bit Rate. 
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Claim 4In video coding equipment indicated to either Claim 1 thru/or Claim 3, By a predetermined function which has a 
means to compute picture complexity from a picture characteristic parameter detected by a means to detect a 
generated code amount, a normal child-ized scale, and the coded image characteristic of each of said detected picture, 
and makes said picture complexity a factor. Video coding equipment changing said 2nd amount of allocation codes. 
Claim 5In video coding equipment indicated to either Claim 1 thru/or Claim 4, It has a stream division means which 
takes out a part of output-codes sequence coded by said variable-length-coding means, Video coding equipment, 
wherein said 1st code-quantity-control means controls a code amount of said whole output-codes sequence and 
controls some code amounts of said output-codes sequence taken out from said stream division means by said 2nd 
code-quantity-control means. 

Claim 6A video encoding method which codes an input moving image image by motion-compensation-prediction step, 
orthogonal-transformation step, quantization step, and a variable-length-coding step, comprising: 
A step which detects a generated code amount of each picture of said input moving image image. 
A step which detects a normal child-ized scale of each picture of said input moving image image. 
A step which detects the coded image characteristic of said input moving image image at least among motion- 
compensation-prediction pictures generated by said input moving image image and said motion-compensation- 
prediction step. 

The 1st code-quantity-control step that computes the amount of allocation codes of a picture coded next from a normal 
child-ized scale detected by generated code amount detected by a step which detects said generated code amount, and 
a step which detects said quantizing scale. 

The 2nd code-quantity-control step that computes the 2nd amount of allocation codes for adding restriction to said 1st 
amount of allocation codes. 

A step which determines a quantizing scale of a picture coded to said next from the amount of allocation codes 
computed at the said 1st and 2nd code-quantity-control steps. 

Claim 7In a video encoding method indicated to Claim 6, said 2nd amount of allocation codes, a picture type (I picture, 
P picture, B picture) — a maximum of the amount of allocation codes being computed independently, and, When 
determining the actual amount of allocation codes in said 1st code-quantity-control step, A video encoding method 
determining the 2nd amount of allocation codes when said 1st computed amount of allocation codes exceeds a 
maximum of the amount of allocation codes set up in said 2nd amount of allocation codes, and determining said 1st 
amount of allocation codes as a actual amount of allocation codes when other. 

Claim 8In a video encoding method indicated to Claim 6 or Claim 7, a generated code amount of each of said detected 
picture, A video encoding method characterized by changing said 2nd amount of allocation codes by a predetermined 
function which has a step which computes picture complexity from a normal child-ized scale and a picture characteristic 
parameter detected at a step which detects the coded image characteristic, and makes said picture complexity a factor. 

Claim 9In a video encoding method indicated to either Claim 6 thru/or Claim 8, It has a stream division step which 
takes out a part of output-codes sequence coded by said variable-length-coding step, A video encoding method, 
wherein said 1st code-quantity-control step controls a code amount of said whole output-codes sequence and controls 
some code amounts of said output-codes sequence taken out from said stream division means by said 2nd code- 
quantity-control step. 



Detailed Description of the Invention 
0001 

Field of the InventionHigh efficiency coding of video is started, and when performing variable bit rate encoding 

especially, it is related with a suitable code quantity controller and a method for the same. 

0002 

Description of the Prior ArtMPEG 2 is already specified as international standards of the technology which codes 
video, such as a television signal, highly efficiently. MPEG 2 divides the "frame" picture which constitutes video into the 
16xl6-pixel block called a "macroblock", The movement quantity called a "motion vector" to each macro block unit in 
time in a front or the back between the predetermined image comparison and coded image which left several frames is 
calculated, "Motion-compensation-prediction" technology which constitutes a coded image from an image comparison 
based on this movement quantity, It is specified to the error signal or the coded image itself of motion compensation 
prediction based on the component engineering of two image coding of "conversion coding" technology which 
compresses the amount of information using DCT (discrete cosine transform) which is a kind of an orthogonal 
transformation. 

0003The example of 1 composition of the video coding equipment of the conventional MPEG 2 is shown in drawing 7, 
and an example of coding picture structure is shown in drawing 6. Motion compensation prediction is consisted of by 
combination of three kinds of pictures like coding picture structure which was shown in drawing 7, which are called I 
picture (formation of a frame inner code), P picture (forward direction prediction coding), and B picture (bidirectional 
prediction coding) and from which a prediction method differs. As shown in drawing 7, in conversion coding, DCT is 
given by DCT device 72 to the coded image itself to the output of the subtracter 71 which is an error signal of motion 
compensation prediction with the motion-compensation-prediction machine 77 in P and B picture at I picture. 
0004After quantization controls by the output of the code quantity controller 90 and is made with the quantizer 73 to 
the DCT coefficient obtained by this DCT device 72, Variable length coding is made with the variable-length-coding 
machine 75 with the attendant information of others, such as a motion vector, and it is outputted after a code sequence 
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is memorized by the buffer 76 as a "bit stream." Under the present circumstances, according to the sufficiency degree 
of the buffer 76, a quantizing scale is controlled by the code quantity controller 90. On the other hand, it supplies now 
decodes local and the power coefficient of the quantizer 73 is stored in the inverse quantization device 77 and the 
IDCT machine 78 by the frame memory 81 for every block. 

OOOSSince MPEG 2 is variable length coding, the generated code amount per unit time (bit rate) is not constant. Then, 
it is possible by changing suitably the quantizing scale in the case of quantization with the quantizer 73 into a macro 
block unit to control to the necessary bit rate. In MPEG 2 Test Model 5, the fixed bit rate control method which makes a 
generated code amount regularity by GOP units is proposed. 

0006In Test Model 5, code amount assignment which changes with picture types is performed. While assigning most 
many code amounts to I picture to which frame inner code-ization is performed, the quantizing scale of B picture with 
which a decoded image is not again used for prediction is increased 1.4 times of I and P picture, So that the code 
amount to B picture may be reduced, a decoded image may assign many the part to I and P picture which are used for 
prediction and the image quality of a decoded image may become fixed between picture types by lessening the code 
amount to assign further, Optimization of the code amount assignment by a picture type is attained. 
0007The fixed bit rate control method in this Test Model 5 is an effective method to the use as which a fixed transfer 
rate is required. However, since the almost same code amount is assigned to every portion of a video sequence, image 
quality deterioration will arise, without giving sufficient code amount to the complicated scene containing many amount 
of information. On the other hand, when the amount of information was few simple scenes, the code amount became a 
surplus and futility arose, and to the use in which a variable transfer rate is possible, it was not able to be said to be 
the suitable rate control method like DVD-Video. 

0008The rate control method which solves the above problems is the Variable Bit Rate control method. JP,H6- 
141298,A has disclosed the coding equipment by Variable Bit Rate control. In this equipment, first, to an input moving 
image image, temporary coding is performed and a generated code amount counts for every unit time with a fixed 
quantity child-ized scale. Next, based on the generated code amount at the time of temporary coding, the target 
transfer rate of each portion is set up so that the generated code amount of the whole input moving image image may 
become a necessary value, and — receiving an input moving image image, controlling to agree in this target transfer 
rate — the 2nd time — it codes, and in other words, actual code-ization is performed. 

0009However, by the above-mentioned conventional example, in order to obtain an output bit stream, at least two 
coding must be performed, and for a use of which real time nature is required, Variable Bit Rate control of a two pass 
system like this equipment cannot be used. 

OOlOOn the other hand, the Variable Bit Rate control method for coding video in real time mostly, i.e., the Variable Bit 
Rate control method of an one-pass system, exists. The coding equipment by the Variable Bit Rate control method of an 
one-pass system is indicated by JP,H10-164577,A at drawing 6 of said gazette, etc. 

OOllThe example of 1 composition of the video coding equipment in this conventional example is shown in drawing 8. 
Identical codes are attached to drawing 7 and an identical configuration part, and the explanation is omitted. The 
generated code amount in the equipment of this conventional example, supply the code amount memorized to the 
buffer 76 to the generated code amount detector 83, and according to this generated code amount detector 83, The 
quantizing scale from the quantizer 73 is supplied to the normal child-ized scale detector 82, It asks with the picture 
complexity calculation machine 84 by making a product with the average value of the quantizing scale in the screen by 
this normal child-ized scale detector 82 into "picture complexity", Based on the rate of the present picture complexity to 
the average value of the past picture complexity, the code-quantity-control machine 74 has realized Variable Bit Rate 
control by determining the target generated code quantity of a screen, or a targeted amount child-ized scale. 
0012 

Problem to be solved by the inventionHowever, in Variable Bit Rate control, in many cases, restriction by a 
maximum transfer rate is received. When the target average bit rate is smaller enough than a maximum transfer rate, 
it is possible to make code amount assignment to B picture smaller than I and P picture like Test Model 5, and to 
optimize the code amount assignment between picture types. 

0013If the target average bit rate becomes close to a maximum transfer rate, the amount of allocation codes of I and 
P picture will come to receive restriction by a maximum transfer rate, the difference of the amount of allocation codes 
with B picture will contract, and, occasionally the amount of allocation codes will become almost the same between 
picture types. After the difference of the amount of allocation codes became small, compared with B picture, the image 
quality of I and P picture worsened relatively, and although the target average bit rate was high, there was a problem 
that image quality deterioration will be perceived by the difference of the image quality resulting from unsuitable code 
amount distribution. 

0014Then, in the Variable Bit Rate control method of the one pass in video coding equipment, and a two pass system, 
an object of this invention is to provide the method of realizing more suitable code amount assignment between picture 
types, when the target average bit rate is close to a maximum transfer rate. 
0015 

Means for solving problemln the video coding equipment provided with each means of motion compensation 
prediction, such as MPEG 2, an orthogonal transformation, quantization, and variable length coding in this invention, 
The 1st code-quantity-control means that determines the amount of allocation codes of the picture coded next from the 
generated code amount of each picture, a means to detect a normal child-ized scale and the obtained generated code 
amount, and a normal child-ized scale, It has the 2nd code-quantity-control means for adding restriction to the amount 
of allocation codes obtained by the 1st code-quantity-control means for every picture type. For example, when 
performing code amount assignment by Variable Bit Rate control, by the 1st code-quantity-control means, the amount 
of allocation codes by Variable Bit Rate control is calculated, and the maximum of the amount of allocation codes by 
fixed bit rate control of the highest transfer rate is searched for by the 2nd code-quantity-control means. Only when the 
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amount of allocation codes obtained by the 1st code-quantity-control means exceeds the maximum of the amount of 
allocation codes obtained by the 2nd code-quantity-control means, the code amount actually assigned to each picture, 
The maximum is made into the actual amount of allocation codes, and when other, let the amount of allocation codes 
obtained by the 1st code-quantity-control means be the actual amount of allocation codes. It becomes possible to hold 
the code amount assignment between picture types the optimal, without giving many code amounts unnecessary for B 
picture by this, when the target average bit rate is close to a maximum transfer rate. 

0016Picture complexity produced with the above-mentioned video coding equipment by performing predetermined 
operation to a generated code amount of each picture and a product of a normal child-ized scale is used, By setting up 
a predetermined function which makes picture complexity a factor, multiplying a maximum of the amount of allocation 
codes obtained by the 2nd aforementioned code-quantity-control means by this function, and changing a maximum of 
the amount of allocation codes, when performing Variable Bit Rate control of an one-pass system, Increase of a code 
amount in a portion near a maximum of the amount of allocation codes is controlled, and it becomes possible to ease 
image quality change at a point beyond a maximum of the amount of allocation codes. 

0017a case where apply the above-mentioned video coding equipment and one encoded bit streams are shared by two 
decoding systems — for example, the bit stream whole — I, P, and all B pictures — by ****** usual coding. When one 
decoding system decodes the whole bit stream and only I and P picture are decoded in another decoding system, 
Control a code amount of the whole bit stream by the 1st code-quantity-control means, and a code amount of bit 
stream portions of only I and P picture is controlled by the 2nd code-quantity-control means, It is possible by 
performing code amount assignment of the 1st code-quantity-control means to perform coding which can be decoded in 
two decoding systems with one coding equipment, restricting a code amount of I and P picture to the amount of 
allocation codes obtained by the 2nd code-quantity-control means. 
0018 

Mode for carrying out the inventionThe 1st embodiment of video coding equipment of this invention is described 
below with drawing 1. As shown in drawing 1, video coding equipment of this invention, and the 1st embodiment of the 
method, The subtractor 11, DCT device 12, the quantizer 13, the variable-length-coding machine 15, the buffer 16, the 
inverse quantization device 17, the IDCT machine 18, the motion-compensation-prediction machine 19, the adding 
machine 20, the frame memory 21, the normal child-ized scale detector 22, the generated code amount detector 23, 
the picture complexity calculation machine 24, It comprises the picture characteristic detector 25, the VBR code- 
quantity-control machine 51, and the CBR code-quantity-control machine 52. 

0019A motivation picture shall be beforehand divided into a macro block unit by image block separator (not shown). 
Motion compensation prediction is not performed about I picture, but a divided motivation picture is quantized by a 
quantizing scale sent from the code-quantity-control machine 14 with the quantizer 13, after DCT of the motivation 
image block itself is sent and carried out to DCT device 12 which is a kind of a DC to AC converter via the subtractor 
11. 

0020The quantized signal is changed into a mark with the variable-length-coding machine 15, and a mark is outputted 
after being adjusted by the following buffer 16. On the other hand, local decoding is carried out with the inverse 
quantization device 17 and the IDCT machine 18, and a power coefficient of the quantizer 13 is stored in the frame 
memory 21 for every block, without adding an output of the motion-compensation-prediction machine 19 with the 
adding machine 20. 

0021About P and B picture, a divided motivation image and a predetermined local decoded image block stored in the 
frame memory 21 are supplied to the motion-compensation-prediction machine 19, Motion vector detection and a 
motion compensation are performed here, and an error image block whose estimated image block difference between 
pixels is taken between original image blocks with the subtractor 11, and is a difference value is sent to DCT device 12. 
0022A mark is outputted after DCT of the difference value was carried out by DCT device 12, it is changed into a mark 
with the variable-length-coding machine 15 like I picture after being quantized by a quantizing scale sent from the 
code-quantity-control machine 14 with the quantizer 13, and being adjusted by the following buffer 16 after this. 
0023Said estimated image block from the motion-compensation-prediction machine 19 is added for every pixel by the 
adding machine 20, and a power coefficient of the quantizer 13 is stored in the frame memory 21 for every block, after 
local decoding is carried out with the inverse quantization device 17 and the IDCT machine 18. About each picture, a 
quantizing scale for every macroblock is sent to the normal child-ized scale detector 22 from the quantizer 13, a 
quantizing scale for one frame is added there, and a normal child-ized scale of one frame is computed. 
0024On the other hand, in the buffer 16, a generated code amount is supervised and the value is sent to the 
generated code amount detector 23. In this generated code amount detector 23, a generated code amount is added per 
frame and a generated code amount of one frame is detected. A normal child-ized scale and a generated code amount 
which were detected about every frame are sent to the picture complexity calculation machine 24 and the CBR code- 
quantity-control machine 52, respectively. 

00250n the other hand, in the picture characteristic detector 25, a divided original image is inputted, a parameter 
which shows a picture characteristic to a macro block unit about each frame of an original image, i.e., an activity, is 
detected, it is added per frame, and the result is sent to the picture complexity calculation machine 24. 
0026Namely, since, as for the case of I picture, motion compensation prediction is not performed as for an input to the 
picture characteristic detector 25, Only a motivation picture divided into a macro block unit is inputted, an activity 
(ACTcur) which is a parameter which shows a picture characteristic to a macro block unit is detected, and it is added 
per frame, and is sent to the picture complexity calculation machine 24 as the activity ACTi of I picture. 
0027Although distribution of a luminance value, a difference value between pixels, etc. can be considered as an 
activity (ACTcur), other parameters may be used as long as a picture characteristic is shown. 

00280n the other hand, an input to the picture characteristic detector 25 shown in drawing 1, In the case of P and B 
picture, a motion vector used besides a divided motivation picture by error picture in motion compensation prediction of 
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a macro block unit or a difference image of a coded image and an image comparison in motion vector detection, and 
motion compensation prediction is inputted from the motion-compensation-prediction machine 19. The activity (original 
image) ACTcur is detected from a divided motivation picture by macro block unit as well as a case of I picture. 
00290n the other hand, in it, an absolute value sum or the square error sum is taken, and an error picture in motion 
compensation prediction of a macro block unit or a difference image of a coded image and an image comparison in 
motion vector detection is detected as the prediction activity ACTpred. Between contiguity macroblocks, an absolute 
value of difference is taken for every ingredient, and a direction of a motion vector used by motion compensation 
prediction is detected as ACT mv. 

0030And for every macroblock, by the operation of a following formula (1), ACTmb is computed, and it is added by one 
frame and sent to the picture complexity calculation machine 24 as the activities ACTp and ACTb of P and B picture. 
0031 

ACTmb=a-ACTcur+b-ACTpred+c-ACTmv (1)0032A picture exception changes the value of each constant a, b, and c 
according to prediction mode of a macroblock (are they intra, uni-directional prediction, or bidirectional prediction?) etc. 
For example, since it is thought that a generated code amount increases compared with the block which predicts by 
being set to b=c=0 since it does not predict like I picture in the case of Intra, the value of a is enlarged. 
0033Thus, presumption of the picture complexity based more on the coding characteristic is attained by performing 
activity detection adapted to prediction mode etc. 

0034With the picture complexity calculation machine 24, after the multiplication of the normal child-ized scale and 
generated code amount of each frame which were supplied is carried out, predetermined conversion is performed to a 
multiplication result, and it asks as picture complexity (past) of each frame. Average picture complexity Xi-ave of each 
picture type, Xp-ave, and Xb-ave are computed by division of the picture complexity being done with the frame number 
of the same picture type within the period, after the value within fixed time is added according to a coding picture type. 

0035The frame number beforehand defined in front in time within the fixed time said here from the picture which 
coding just ended, For example, there is also a case of fixed frame numbers, such as 15 frames and 300 frames, and a 
frame number may increase one by one like to the picture which coding just ended from the encoding start 
frame . When not fulfilling the fixed time which the coded frame number defined by the case of the former fixed frame 
number, either, the frame number will increase one by one like the latter. 

0036Picture complexity Xk-c (k= i, p, b) of the present picture to be coded from now on, The activity of the present 
picture can be presumed by the following formula (2) from ACTk (k= i, p, b), the same picture complexity Xk-p (k= i, 
p, b) of the picture of a picture type coded just before, and activity ACTk-p (k= i, p, b). 
0037 

Xk-c= Xk-p-ACTk/ ACTk-p (2)0038When the frame which coding of the same picture type ended does not exist in an 
initial state, it asks for the picture complexity and the activity of the picture of each picture type by some pictures 
beforehand, What is necessary is to average it statistically according to the occurrence frequency of average video, and 
just to let it be an initial value. 

0039Average picture complexity Xi-ave of each picture type, Xp-ave, and Xb-ave, Presumed picture complexity Xi-c of 
the present picture to be coded from now on, Xp-c, and Xb-c are sent to the VBR code-quantity-control machine 51, 
and setting out of a quantizing scale for Variable Bit Rate control is performed here. If a frame number of 1GOP (usually 
interval of I picture) which is PictureRate and one encoding unit about BitRate and a frame number per second in the 
target average bit rate is set to N, the amount Rave of average allocation codes of 1GOP will be given with a following 
formula (3). 
0040 

Rave = -(BitRate/PictureRate) N (3)0041If Rave of an upper type considers it as the amount of required allocation 
codes of 1GOP at the time of average picture complexity, If a picture of 1GOP including the present picture to be coded 
from now on assumes that it is equal to presumed picture complexity of the present picture uniformly searched for with 
said picture complexity calculation machine 24, image quality will be given to the amount Rck (k= i, p, b) of required 
allocation codes of 1GOP uniformly required for a ****** case with a following formula (4). 
0042 

Rck= Rave-Xk-c/Xk-ave (4)0043By assigning Rck (k= i, p, b) of an upper type suitable for each picture of 1GOP, the 
target code quantity in the 1st code-quantity-control means of the present picture to be coded from now on is 
computed. Although the target-code-quantity allocation method of MPEG 2 Test Model 5 is listed to below as an 
example, methods other than this may be used. 

0044The setting-out ratio of the quantizing scale of P contained in 1GOP, P as opposed to Np, Nb, and I picture for 
the frame number of B picture , and B picture is set to Kp and Kb. At this time, the target assignment code amounts 
Ti, Tp, and Tb of each picture type are given with the following formula (5), (6), and (7). MAX a and b - either a or b - 
- the operation which chooses the larger one is shown. Xi, Xp, and Xb are the picture complexity (product of the normal 
child-ized scale of the picture concerned, and a generated code amount) of the picture coded immediately before here. 
0045 

(I picture) Ti= MAX A and B A = Rc/(l+Np-xp/(xi-K P ) + Nb-xb/(xi-Kb)) B = BitRate/(8 and PictureRate) 

(5) 0046 

(P picture) Tp= MAX C and D C = Rc/(Np+Nb-Kp-xb/(Kb-xp)) D = BitRate/(8 and PictureRate) 

(6) 0047 

(B picture) Tb= MAX E and FE = Rc/(Np+Np-Kb-xp/(Kp-Kb)) F = BitRate/(8 and PictureRate) 

(7) 00480n the other hand with the CBR code-quantity-control machine 52, a normal child-ized scale of a frame unit, A 
generated code amount is inputted and the picture complexity Xi of a picture coded from both product just before, Xp, 
and Xb are calculated, Target assignment code amount Ti-max of each picture type in case BitRate is the highest 
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transfer rate (BitRateMax), Tp-max, and Tb-max are calculated like the target assignment code amounts Ti, Tp, and Tb 
in the 1st code-quantity-control means. Here, amount Rav-max of average allocation codes of 1GOP is common to each 
picture, and is given with a following formula (8). 
0049 

Rav-max= -(BitRateMax/PictureRate) N (8) Therefore, 0050 

(I picture) Ti-max= MAX A and B A =Rav-max /(l+Np-xp/(xi-K P ) +Nb-xb/(xi-Kb)) B = BitRateMax/(8 and PictureRate) 

(9) 0051 

(P picture) Tp-max = MAX C and D C =Rav-max /(Np+Nb-Kp-xb/(Kb-xp)) D = BitRateMax/(8 and PictureRate) 

(10) 0052 

(B picture) Tb-max = MAX E and F E = Rav-max/(Np+N P -Kb-xp/(K P -Kb)) F = BitRateMax/(8 and PictureRate) 

(11) 0053Ti-max of an upper type, Tp-max, and Tb-max, Namely, it is a maximum of a target assignment code amount 
in the 2nd code-quantity-control means, These values are sent to the VBR code-quantity-control machine 51, about the 
picture type concerned of said picture of the present when it codes, a limiting circuit is applied with a value of Ti-max, 
Tp-max, and Tb-max, and a target assignment code amount of the present picture determines a value of said Ti, Tp, 
and Tb. 

0054Based on a target assignment code amount determined as mentioned above and a generated code amount of 
each macroblock detected with the buffer 16, a method of MPEG 2 Test Model 5 is used, and a quantizing scale of each 
macroblock is determined. 

0055From the picture characteristic detector 25, the activity ACTcur of each macroblock is sent also to the code- 
quantity-control machine 51, Although used for adaptive-quantization control which changes a quantizing scale of each 
macroblock based on an activity in MPEG 2 Test Model 5, it is not necessary to perform this adaptive-quantization 
control. A quantizing scale of each macroblock may be determined by a completely different method from this. 
0056A quantizing scale of each macroblock outputted from the code-quantity-control machine 51 is sent to the 
quantizer 13, A mark is outputted, after variable length coding of the present picture (a divided original image after 
DCT or an error image block of motion compensation prediction) is quantized and carried out with this quantizing scale 
and it is adjusted with the buffer 16. 

0057A generated code amount supervised with a quantizing scale for every macroblock and the buffer 16 is sent to the 
normal child-ized scale detector 22 and the generated code amount detector 23, and is used for code quantity control 
of the following picture, respectively. 

0058In the upper explanation, amount Rav-max of average allocation codes of 1GOP in the CBR code-quantity-control 
machine 52 was calculated as a code amount to which it is simply assigned by 1GOP at the time of the highest transfer 
rate (BitRateMax).On the other hand, if presumed picture complexity Xk-c of a predetermined function like drawing 2 
(a) which makes a factor presumed picture complexity Xk-c (k= i, p, b) of the present picture to be coded from now on, 
for example, the present picture, increases, the value will set up the function f (Xk-c) which approaches 1 infinite. 
0059By using Rav-max' of a following formula (12) which carried out the multiplication of this function for every 
picture type instead of Rav-max, As shown in drawing 2 (b), press down gradually a generated code amount in a case 
of being close to the highest transfer rate of each picture type, and. Image quality deterioration of the picture type 
concerned produced from relation between picture complexity and the amount of allocation codes becoming 
discontinuous at a point beyond the highest transfer rate becomes possible also pressing down a problem which 
becomes remarkable . 
0060 

Rav-max' - =f(Xk-c), (BitRateMax/PictureRate), andN - a function (k=i, p, b) (12) which shows drawing 2 (a) f (Xk-c) 
here0061The 2nd embodiment of video coding equipment of this invention is described with drawing 3 below. In the 
2nd embodiment, it is a case where this invention is applied to Variable Bit Rate code quantity control of a two pass 
system. A fundamental coding portion until it is changed into a mark with an original image input - the variable-length- 
coding machine 15 is the same as that of the 1st embodiment. Since encoding operation is performed twice (or more 
than it), temporary coding is performed first and the 2nd coding is performed based on a result of the generated code 
amount about one picture, it differs greatly that there is a portion which is different in both encoding operation. 
0062In the 1st coding, a quantizing scale sent to the quantizer 13 is not sent from the VBR code-quantity-control 
machine 51, but a fixed value (values, such as 6 and 8) is sent from the temporary coding quantization set scale 
machine 56 via switch SW1, and, thereby, quantization of a fixed value is performed. And a bit stream after variable 
length coding was performed in the variable-length-coding machine 15 is not sent to the buffer 16 for outputting it 
outside, but it is sent to the temporary coding generated code amount detector 53 via switch SW2, and a generated 
code amount of each picture in the 1st coding is detected. 

0063A temporary transfer rate is computed by a generated code amount being sent to the temporary transfer rate 
memory 54 from the temporary coding generated code amount detector 53 one by one, and being added for every 
prescribed period. This operation is performed until coding of one image sequence is completed, and a temporary 
transfer rate for every prescribed period is accumulated in the temporary transfer rate memory 54. 
0064After the 1st coding is completed, a temporary generated code amount or an average temporary transfer rate of 
the whole image sequence is computed, this value and a temporary transfer rate for every prescribed period are sent to 
the target transfer rate calculation machine 55, and a target transfer rate for every in the 2nd coding (actual-code- 
izing) prescribed period is computed. 

0065The relation of the temporary transfer rate Rt for every prescribed period and target transfer rate R of the 2nd 
coding in the 1st coding sets up the predetermined function beforehand. For example, the following function as shown 
in (13) can be considered. 
0066 

R=a- (Rt) (13) b (a and b are a constant, a> 0, and 0< b<l)0067The 1st temporary coding is completed, and if the 
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target transfer rate of the coding which is the 2nd time is determined, the 2nd coding (actual-code-izing) will be started 
according to the target transfer rate. In the 2nd coding, the value from which the quantizing scale sent to the quantizer 
13 was obtained with the VBR code-quantity-control machine 51 is sent. 

0068The normal child-ized scale of each frame detected with the VBR code-quantity-control machine 51 here with the 
normal child-ized scale detector 22 and the generated code amount detector 23, and a generated code amount, From 
the target transfer rate for every prescribed period computed from the temporary encoded result with the target 
transfer rate calculation machine 55, the target assignment code amount of the picture to be coded from now on is 
calculated. 

00690n the other hand, it is inputted into the VBR code-quantity-control machine 51, a limiting circuit is applied to 
said target assignment code amount, and a target assignment code amount also determines the maximum of the target 
assignment (it can set for 2nd code-quantity-control means) code amount computed with the CBR code-quantity- 
control machine 52. The maximum of the target assignment code amount in the CBR code-quantity-control machine 52 
is the same as that of (based on Rav-max) Ti-max in the 1st embodiment, Tp-max, and Tb-max. 
0070The quantizing scale of each macroblock is determined using the method of MPEG 2 Test Model 5 grade like the 
1st embodiment based on the target assignment code amount determined as mentioned above and the generated code 
amount of each macroblock detected with the buffer 16. 

0071Thus, the quantizing scale of each determined macroblock is sent to the quantizer 13, and variable length coding 
of the picture (the divided original image after DCT or the error image block of motion compensation prediction) to be 
coded from now on is quantized and carried out with this quantizing scale. 

0072A mark is outputted after being adjusted by the target transfer rate for every prescribed period which the bit 
stream generated here was supplied to the buffer 16 by the 2nd coding, and was computed with the target transfer 
rate calculation machine 55 here. The generated code amount supervised with the quantizing scale for every 
macroblock and the buffer 16 is sent to the normal child-ized scale detector 22 and the generated code amount 
detector 23, and is used for the code quantity control of the following picture, respectively. 

0073The 3rd embodiment of the video coding equipment of this invention is described with drawing 4 and drawing 5 
below. Although the above embodiments 1st and 2nd are the cases where this invention is applied to Variable Bit Rate 
code quantity control, this invention is not limited to it but broad application is possible for it. Like the video coding 
equipment shown in drawing 4, the encoded bit streams of the output of the buffer 16 are divided into two with the 
stream separator 59. The output of one of these outputs the whole encoded bit streams which use I like drawing 5, P, 
and all B pictures, and another side outputs the encoded bit streams which use only I and P picture before long. 
0074An output of only I and P picture shall be a header conversion machine which is not illustrated here, and a 
parameter of a header part, etc. shall be rewritten by suitable value. The code-quantity-control machine 1 (51A) of 
drawing 4 controls a code amount of the whole bit stream, and the code-quantity-control machine 2 (52A) controls a 
code amount of a bit stream of only I and P picture. 

0075Here, both average bit rate shall be set up so that the amount of average allocation codes of each picture type 
may serve as a comparatively near value with the code-quantity-control machine 1 (51A) and the code-quantity-control 
machine 2 (52A). In order to satisfy code quantity control of two bit streams simultaneously, a code amount quota 
result of I in the code-quantity-control machine 2 (52A) and P picture is sent to the code-quantity-control machine 1 
(51A), With the code-quantity-control machine 1 (51A), to I and P picture, I as a result of the code-quantity-control 
machine 2 (52A) and code amount assignment of P picture are applied as it is, code amount assignment is newly 
performed about B picture, and control of the code-quantity-control machine 1 (51A) is realized. 
0076Thereby, by the whole bit stream, while control with the code-quantity-control machine 1 (51A) is performed, 
when I of a bit stream and P picture portion are taken out with the stream separator 59, a bit stream controlled by the 
code-quantity-control machine 2 (52A) can be obtained. 

0077When a bit stream of only I and P picture does not need to be outputted with the stream separator 59, in the 
code-quantity-control machine 1 (51A), the usual code amount assignment is performed about I, P, and B pictures of 
each, without performing code amount assignment with the code-quantity-control machine 2 (52A). When not 
performing code amount assignment with the code-quantity-control machine 2 (52A), a signal which shows it is sent to 
the stream separator 59, and an output is stopped for a bit stream of only I and P picture there. 
0078In a code-quantity-control form in which not only an embodiment of drawing 4 but this invention has two code- 
quantity-control machines, as opposed to the code-quantity-control machine 51A of a main direction — ** — by adding 
restriction by a code amount quota result for every picture type of the code-quantity-control machine 52A of a 
direction, Rationalization of code amount assignment of each picture type can be attained, or video coding equipment 
corresponding to two decoding systems can be realized to one encoded bit streams. 
0079 

Effect of the InventfonThe 1st code-quantity-control means that determines the amount of allocation codes of a 
coded image as mentioned above according to this invention, It has the 2nd code-quantity-control means that adds 
restriction to code amount assignment of the 1st code-quantity-control means, In Variable Bit Rate control, by the 1st 
code-quantity-control means For example, Variable Bit Rate control, By the 2nd code-quantity-control means, calculate 
the amount of allocation codes by fixed bit rate control of the highest transfer rate, and the actual amount of allocation 
codes, Only when the amount of allocation codes obtained by the 1st code-quantity-control means exceeds the amount 
of allocation codes obtained by the 2nd code-quantity-control means, the amount of allocation codes obtained by the 
2nd code-quantity-control means is applied, and when other, the amount of allocation codes obtained by the 1st code- 
quantity-control means is applied. It becomes possible to hold the code amount assignment between picture types the 
optimal, without giving many code amounts unnecessary for B picture by this, when the target average bit rate is close 
to a maximum transfer rate. 

0080When control using the picture complexity produced by Variable Bit Rate control of an one-pass system by 
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performing predetermined operation to the generated code amount of each picture and the product of a normal child- 
ized scale is performed, By setting up the predetermined function which makes picture complexity a factor, multiplying 
the maximum of the amount of allocation codes obtained by the 2nd aforementioned code-quantity-control means by 
this function, and changing the maximum of the amount of allocation codes, Increase of the code amount in the portion 
near the maximum of the amount of allocation codes is controlled, and it becomes possible to ease image quality 
change at the point beyond the maximum of the amount of allocation codes. 

0081Also in the case where apply the above-mentioned video coding equipment and one encoded bit streams are 
shared by two decoding systems, By restricting code amount assignment of the 1st code-quantity-control means by 
code amount assignment obtained by the 2nd code-quantity-control means, it becomes possible to perform the coding 
which can be decoded in two decoding systems with one coding equipment. 



Field of the InventionHigh efficiency coding of video is started, and when performing variable bit rate encoding 
especially, it is related with a suitable code quantity controller and a method for the same. 



Description of the Prior ArtMPEG 2 is already specified as international standards of the technology which codes 
video, such as a television signal, highly efficiently. MPEG 2 divides the "frame- picture which constitutes video into the 
16xl6-pixel block called a "macroblock", The movement quantity called a "motion vector" to each macro block unit in 
time in a front or the back between the predetermined image comparison and coded image which left several frames is 
calculated, "Motion-compensation-prediction" technology which constitutes a coded image from an image comparison 
based on this movement quantity, It is specified to the error signal or the coded image itself of motion compensation 
prediction based on the component engineering of two image coding of "conversion coding" technology which 
compresses the amount of information using DCT (discrete cosine transform) which is a kind of an orthogonal 
transformation. 

0003The example of 1 composition of the video coding equipment of the conventional MPEG 2 is shown in drawing 7, 
and an example of coding picture structure is shown in drawing 6. Motion compensation prediction is consisted of by 
combination of three kinds of pictures like coding picture structure which was shown in drawing 7, which are called I 
picture (formation of a frame inner code), P picture (forward direction prediction coding), and B picture (bidirectional 
prediction coding) and from which a prediction method differs. As shown in drawing 7, in conversion coding, DCT is 
given by DCT device 72 to the coded image itself to the output of the subtractor 71 which is an error signal of motion 
compensation prediction with the motion-compensation-prediction machine 77 in P and B picture at I picture. 
0004After quantization controls by the output of the code quantity controller 90 and is made with the quantizer 73 to 
the DCT coefficient obtained by this DCT device 72, Variable length coding is made with the variable-length-coding 
machine 75 with the attendant information of others, such as a motion vector, and it is outputted after a code sequence 
is memorized by the buffer 76 as a "bit stream." Under the present circumstances, according to the sufficiency degree 
of the buffer 76, a quantizing scale is controlled by the code quantity controller 90. On the other hand, it supplies now 
decodes local and the power coefficient of the quantizer 73 is stored in the inverse quantization device 77 and the 
IDCT machine 78 by the frame memory 81 for every block. 

OOOSSince MPEG 2 is variable length coding, the generated code amount per unit time (bit rate) is not constant. Then, 
it is possible by changing suitably the quantizing scale in the case of quantization with the quantizer 73 into a macro 
block unit to control to the necessary bit rate. In MPEG 2 Test Model 5, the fixed bit rate control method which makes a 
generated code amount regularity by GOP units is proposed. 

0006In Test Model 5, code amount assignment which changes with picture types is performed. While assigning most 
many code amounts to I picture to which frame inner code-ization is performed, the quantizing scale of B picture with 
which a decoded image is not again used for prediction is increased 1.4 times of I and P picture, So that the code 
amount to B picture may be reduced, a decoded image may assign many the part to I and P picture which are used for 
prediction and the image quality of a decoded image may become fixed between picture types by lessening the code 
amount to assign further, Optimization of the code amount assignment by a picture type is attained. 
0007The fixed bit rate control method in this Test Model 5 is an effective method to the use as which a fixed transfer 
rate is required. However, since the almost same code amount is assigned to every portion of a video sequence, image 
quality deterioration will arise, without giving sufficient code amount to the complicated scene containing many amount 
of information. On the other hand, when the amount of information was few simple scenes, the code amount became a 
surplus and futility arose, and to the use in which a variable transfer rate is possible, it was not able to be said to be 
the suitable rate control method like DVD-Video. 

0008The rate control method which solves the above problems is the Variable Bit Rate control method. JP,H6- 
141298,A has disclosed the coding equipment by Variable Bit Rate control. In this equipment, first, to an input moving 
image image, temporary coding is performed and a generated code amount counts for every unit time with a fixed 
quantity child-ized scale. Next, based on the generated code amount at the time of temporary coding, the target 
transfer rate of each portion is set up so that the generated code amount of the whole input moving image image may 
become a necessary value, and — receiving an input moving image image, controlling to agree in this target transfer 
rate — the 2nd time — it codes, and in other words, actual code-ization is performed. 

0009However, by the above-mentioned conventional example, in order to obtain an output bit stream, at least two 
coding must be performed, and for a use of which real time nature is required, Variable Bit Rate control of a two pass 
system like this equipment cannot be used. 
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OOlOOn the other hand, the Variable Bit Rate control method for coding video in real time mostly, i.e., the Variable Bit 
Rate control method of an one-pass system, exists. The coding equipment by the Variable Bit Rate control method of an 
one-pass system is indicated by JP,H10-164577,A at drawing 6 of said gazette, etc. 

OOllThe example of 1 composition of the video coding equipment in this conventional example is shown in drawing 8. 
Identical codes are attached to drawing 7 and an identical configuration part, and the explanation is omitted. The 
generated code amount in the equipment of this conventional example, supply the code amount memorized to the 
buffer 76 to the generated code amount detector 83, and according to this generated code amount detector 83, The 
quantizing scale from the quantizer 73 is supplied to the normal child-ized scale detector 82, It asks with the picture 
complexity calculation machine 84 by making a product with the average value of the quantizing scale in the screen by 
this normal child-ized scale detector 82 into "picture complexity", Based on the rate of the present picture complexity to 
the average value of the past picture complexity, the code-quantity-control machine 74 has realized Variable Bit Rate 
control by determining the target generated code quantity of a screen, or a targeted amount child-ized scale. 



Effect of the InventionThe 1st code-quantity-control means that determines the amount of allocation codes of a 
coded image as mentioned above according to this invention, It has the 2nd code-quantity-control means that adds 
restriction to code amount assignment of the 1st code-quantity-control means, In Variable Bit Rate control, by the 1st 
code-quantity-control means For example, Variable Bit Rate control, By the 2nd code-quantity-control means, calculate 
the amount of allocation codes by fixed bit rate control of the highest transfer rate, and the actual amount of allocation 
codes, Only when the amount of allocation codes obtained by the 1st code-quantity-control means exceeds the amount 
of allocation codes obtained by the 2nd code-quantity-control means, the amount of allocation codes obtained by the 
2nd code-quantity-control means is applied, and when other, the amount of allocation codes obtained by the 1st code- 
quantity-control means is applied. It becomes possible to hold the code amount assignment between picture types the 
optimal, without giving many code amounts unnecessary for B picture by this, when the target average bit rate is close 
to a maximum transfer rate. 

0080When control using the picture complexity produced by Variable Bit Rate control of an one-pass system by 
performing predetermined operation to the generated code amount of each picture and the product of a normal child- 
ized scale is performed, By setting up the predetermined function which makes picture complexity a factor, multiplying 
the maximum of the amount of allocation codes obtained by the 2nd aforementioned code-quantity-control means by 
this function, and changing the maximum of the amount of allocation codes, Increase of the code amount in the portion 
near the maximum of the amount of allocation codes is controlled, and it becomes possible to ease image quality 
change at the point beyond the maximum of the amount of allocation codes. 

0081Also in the case where apply the above-mentioned video coding equipment and one encoded bit streams are 
shared by two decoding systems, By restricting code amount assignment of the 1st code-quantity-control means by 
code amount assignment obtained by the 2nd code-quantity-control means, it becomes possible to perform the coding 
which can be decoded in two decoding systems with one coding equipment. 



Problem to be solved by the InventionHowever, in Variable Bit Rate control, in many cases, restriction by a 
maximum transfer rate is received. When the target average bit rate is smaller enough than a maximum transfer rate, 
it is possible to make code amount assignment to B picture smaller than I and P picture like Test Model 5, and to 
optimize the code amount assignment between picture types. 

0013If the target average bit rate becomes close to a maximum transfer rate, the amount of allocation codes of I and 
P picture will come to receive restriction by a maximum transfer rate, the difference of the amount of allocation codes 
with B picture will contract, and, occasionally the amount of allocation codes will become almost the same between 
picture types. After the difference of the amount of allocation codes became small, compared with B picture, the image 
quality of I and P picture worsened relatively, and although the target average bit rate was high, there was a problem 
that image quality deterioration will be perceived by the difference of the image quality resulting from unsuitable code 
amount distribution. 

0014Then, in the Variable Bit Rate control method of the one pass in video coding equipment, and. a two pass system, 
an object of this invention is to provide the method of realizing more suitable code amount assignment between picture 
types, when the target average bit rate is close to a maximum transfer rate. 



Means for solving problemln the video coding equipment provided with each means of motion compensation 
prediction, such as MPEG 2, an orthogonal transformation, quantization, and variable length coding in this invention, 
The 1st code-quantity-control means that determines the amount of allocation codes of the picture coded next from the 
generated code amount of each picture, a means to detect a normal child-ized scale and the obtained generated code 
amount, and a normal child-ized scale, It has the 2nd code-quantity-control means for adding restriction to the amount 
of allocation codes obtained by the 1st code-quantity-control means for every picture type. For example, when 
performing code amount assignment by Variable Bit Rate control, by the 1st code-quantity-control means, the amount 
of allocation codes by Variable Bit Rate control is calculated, and the maximum of the amount of allocation codes by 
fixed bit rate control of the highest transfer rate is searched for by the 2nd code-quantity-control means. Only when the 
amount of allocation codes obtained by the 1st code-quantity-control means exceeds the maximum of the amount of 
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allocation codes obtained by the 2nd code-quantity-control means, the code amount actually assigned to each picture, 
The maximum is made into the actual amount of allocation codes, and when other, let the amount of allocation codes 
obtained by the 1st code-quantity-control means be the actual amount of allocation codes. It becomes possible to hold 
the code amount assignment between picture types the optimal, without giving many code amounts unnecessary for B 
picture by this, when the target average bit rate is close to a maximum transfer rate. 

0016Picture complexity produced with the above-mentioned video coding equipment by performing predetermined 
operation to a generated code amount of each picture and a product of a normal child-ized scale is used, By setting up 
a predetermined function which makes picture complexity a factor, multiplying a maximum of the amount of allocation 
codes obtained by the 2nd aforementioned code-quantity-control means by this function, and changing a maximum of 
the amount of allocation codes, when performing Variable Bit Rate control of an one-pass system, Increase of a code 
amount in a portion near a maximum of the amount of allocation codes is controlled, and it becomes possible to ease 
image quality change at a point beyond a maximum of the amount of allocation codes. 

0017a case where apply the above-mentioned video coding equipment and one encoded bit streams are shared by two 
decoding systems - for example, the bit stream whole - I, P, and all B pictures - by ****** usual coding. When one 
decoding system decodes the whole bit stream and only I and P picture are decoded in another decoding system, 
Control a code amount of the whole bit stream by the 1st code-quantity-control means, and a code amount of bit 
stream portions of only I and P picture is controlled by the 2nd code-quantity-contrpl means, It is possible by 
performing code amount assignment of the 1st code-quantity-control means to perform coding which can be decoded in 
two decoding systems with one coding equipment, restricting a code amount of I and P picture to the amount of 
allocation codes obtained by the 2nd code-quantity-control means. 
0018 

Mode for carrying out the inventionThe 1st embodiment of video coding equipment of this invention is described 
below with drawing 1. As shown in drawing 1, video coding equipment of this invention, and the 1st embodiment of the 
method, The subtractor 11, DCT device 12, the quantizer 13, the variable-length-coding machine 15, the buffer 16, the 
inverse quantization device 17, the IDCT machine 18, the motion-compensation-prediction machine 19, the adding 
machine 20, the frame memory 21, the normal child-ized scale detector 22, the generated code amount detector 23, 
the picture complexity calculation machine 24, It comprises the picture characteristic detector 25, the VBR code- 
quantity-control machine 51, and the CBR code-quantity-control machine 52. 

0019A motivation picture shall be beforehand divided into a macro block unit by image block separator (not shown). 
Motion compensation prediction is not performed about I picture, but a divided motivation picture is quantized by a 
quantizing scale sent from the code-quantity-control machine 14 with the quantizer 13, after DCT of the motivation 
image block itself is sent and carried out to DCT device 12 which is a kind of a DC to AC converter via the subtractor 
11. 

0020The quantized signal is changed into a mark with the variable-length-coding machine 15, and a mark is outputted 
after being adjusted by the following buffer 16. On the other hand, local decoding is carried out with the inverse 
quantization device 17 and the IDCT machine 18, and a power coefficient of the quantizer 13 is stored in the frame 
memory 21 for every block, without adding an output of the motion-compensation-prediction machine 19 with the 
adding machine 20. 

0021About P and B picture, a divided motivation image and a predetermined local decoded image block stored in the 
frame memory 21 are supplied to the motion-compensation-prediction machine 19, Motion vector detection and a 
motion compensation are performed here, and an error image block whose estimated image block difference between 
pixels is taken between original image blocks with the subtractor 11, and is a difference value is sent to DCT device 12. 
0022A mark is outputted after DCT of the difference value was carried out by DCT device 12, it is changed into a mark 
with the variable-length-coding machine 15 like I picture after being quantized by a quantizing scale sent from the 
code-quantity-control machine 14 with the quantizer 13, and being adjusted by the following buffer 16 after this. 
0023Said estimated image block from the motion-compensation-prediction machine 19 is added for every pixel by the 
adding machine 20, and a power coefficient of the quantizer 13 is stored in the frame memory 21 for every block, after 
local decoding is carried out with the inverse quantization device 17 and the IDCT machine 18. About each picture, a 
quantizing scale for every macroblock is sent to the normal child-ized scale detector 22 from the quantizer 13, a 
quantizing scale for one frame is added there, and a normal child-ized scale of one frame is computed. 
00240n the other hand, in the buffer 16, a generated code amount is supervised and the value is sent to the 
generated code amount detector 23. In this generated code amount detector 23, a generated code amount is added per 
frame and a generated code amount of one frame is detected. A normal child-ized scale and a generated code amount 
which were detected about every frame are sent to the picture complexity calculation machine 24 and the CBR code- 
quantity-control machine 52, respectively. 

00250n the other hand, in the picture characteristic detector 25, a divided original image is inputted, a parameter 
which shows a picture characteristic to a macro block unit about each frame of an original image, i.e., an activity, is 
detected, it is added per frame, and the result is sent to the picture complexity calculation machine 24. 
0026Namely, since, as for the case of I picture, motion compensation prediction is not performed as for an input to the 
picture characteristic detector 25, Only a motivation picture divided into a macro block unit is inputted, an activity 
(ACTcur) which is a parameter which shows a picture characteristic to a macro block unit is detected, and it is added 
per frame, and is sent to the picture complexity calculation machine 24 as the activity ACTi of I picture. 
0027Although distribution of a luminance value, a difference value between pixels, etc. can be considered as an 
activity (ACTcur), other parameters may be used as long as a picture characteristic is shown. 

00280n the other hand, the input to the picture characteristic detector 25 shown in drawing 1, In the case of P and B 
picture, the motion vector used besides the divided motivation picture by the error picture in the motion compensation 
prediction of a macro block unit or the difference image of the coded image and image comparison in motion vector 
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detection, and motion compensation prediction is inputted from the motion-compensation-prediction machine 19. The 
activity (original image) ACTcur is detected from the divided motivation picture by the macro block unit as well as the 
case of I picture. 

00290n the other hand, in it, an absolute value sum or the square error sum is taken, and the error picture in the 
motion compensation prediction of a macro block unit or the difference image of the coded image and image 
comparison in motion vector detection is detected as the prediction activity ACTpred. Between contiguity macroblocks, 
the absolute value of difference is taken for every ingredient, and the direction of the motion vector used by motion 
compensation prediction is detected as ACTmv. 

0030And for every macroblock, by the operation of a following formula (1), ACTmb is computed, and it is added by one 
frame and sent to the picture complexity calculation machine 24 as the activities ACTp and ACTb of P and B picture. 
0031 

ACTmb=a-ACTcur+b-ACTpred+c-ACTmv (1)0032A picture exception changes a value of each constant a, b, and c 
according to prediction mode of a macroblock (are they intra, uni-directional prediction, or bidirectional prediction?) etc. 
For example, since it is thought that a generated code amount increases compared with a block which predicts by being 
set to b=c=0 since it does not predict like I picture in the case of Intra, a value of a is enlarged. 
0033Thus, presumption of picture complexity based more on a coding characteristic is attained by performing activity 
detection adapted to prediction mode etc. 

0034With the picture complexity calculation machine 24, after the multiplication of a normal child-ized scale and a 
generated code amount of each frame which were supplied is carried out, predetermined conversion is performed to a 
multiplication result, and it asks as picture complexity (past) of each frame. Average picture complexity Xi-ave of each 
picture type, Xp-ave, and Xb-ave are computed by division of the picture complexity being done with a frame number 
of the same picture type within the period, after a value within fixed time is added according to a coding picture type. 
0035The frame number beforehand defined in front in time within the fixed time said here from the picture which 
coding just ended, For example, there is also a case of fixed frame numbers, such as 15 frames and 300 frames, and a 
frame number may increase one by one like to the picture which coding just ended from the encoding start 
frame . When not fulfilling the fixed time which the coded frame number defined by the case of the former fixed frame 
number, either, the frame number will increase one by one like the latter. 

0036Picture complexity Xk-c (k= i, p, b) of the present picture to be coded from now on, The activity of the present 
picture can be presumed by the following formula (2) from ACTk (k= i, p, b), the same picture complexity Xk-p (k= i, 
p, b) of the picture of a picture type coded just before, and activity ACTk-p (k= i, p, b). 
0037 

Xk-c= Xk-p-ACTk/ ACTk-p (2)0038When the frame which coding of the same picture type ended does not exist in an 
initial state, it asks for the picture complexity and the activity of the picture of each picture type by some pictures 
beforehand, What is necessary is to average it statistically according to the occurrence frequency of average video, and 
just to let it be an initial value. 

0039Average picture complexity Xi-ave of each picture type, Xp-ave, and Xb-ave, Presumed picture complexity Xi-c of 
the present picture to be coded from now on, Xp-c, and Xb-c are sent to the VBR code-quantity-control machine 51, 
and setting out of the quantizing scale for Variable Bit Rate control is performed here. If the frame number of 1GOP 
(usually interval of I picture) which is PictureRate and one encoding unit about BitRate and the frame number per 
second in the target average bit rate is set to N, the amount Rave of average allocation codes of 1GOP will be given 
with a following formula (3). 
0040 

Rave = -(BitRate/PictureRate) N (3)0041If Rave of an upper type considers it as the amount of required allocation 
codes of 1GOP at the time of average picture complexity, If the picture of 1GOP including the present picture to be 
coded from now on assumes that it is equal to the presumed picture complexity of the present picture uniformly 
searched for with said picture complexity calculation machine 24, image quality will be given to the amount Rck (k= i, 
p, b) of required allocation codes of 1GOP uniformly required for a ****** case with a following formula (4). 
0042 

Rck= Rave-Xk-c/Xk-ave (4)0043By assigning Rck (k= i, p, b) of an upper type suitable for each picture of 1GOP, 
target code quantity in the 1st code-quantity-control means of the present picture to be coded from now on is 
computed. Although a target-code-quantity allocation method of MPEG 2 Test Model 5 is listed to below as an example, 
methods other than this may be used. 

0044A setting-out ratio of a quantizing scale of P contained in 1GOP, P as opposed to Np, Nb, and I picture for a 
frame number of B picture , and B picture is set to Kp and Kb. At this time, the target assignment code amounts Ti, 
Tp, and Tb of each picture type are given with the following formula (5), (6), and (7). MAX a and b — either a or b — 
operation which chooses the larger one is shown. Xi, Xp, and Xb are the picture complexity (product of a normal child- 
ized scale of the picture concerned, and a generated code amount) of a picture coded immediately before here. 
0045 

(I picture) Ti= MAX A and B A = Rc/(l+N P -xp/(xi-Kp) +Nb-xb/(xi-Kb)) B = BitRate/(8 and PictureRate) 

(5) 0046 

(P picture) Tp= MAX C and DC = Rc/(Np+Nb-Kp-xb/(Kb-x P )) D = BitRate/(8 and PictureRate) 

(6) 0047 

(B picture) Tb= MAX E and FE = Rc/(Np+Np-Kb-xp/(Kp-Kb)) F = BitRate/(8 and PictureRate) 

(7) 00480n the other hand with the CBR code-quantity-control machine 52, a normal child-ized scale of a frame unit, A 
generated code amount is inputted and the picture complexity Xi of a picture coded from both product just before, Xp, 
and Xb are calculated, Target assignment code amount Ti-max of each picture type in case BitRate is the highest 
transfer rate (BitRateMax), Tp-max, and Tb-max are calculated like the target assignment code amounts Ti, Tp, and Tb 
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in the 1st code-quantity-control means. Here, amount Rav-max of average allocation codes of 1GOP is common to each 

picture, and Is given with a following formula (8). 

0049 

Rav-max= -(BitRateMax/PictureRate) N (8) Therefore,0050 

(I picture) Ti-max= MAX A and B A =Rav-max /(l+Np-x P /(xi-Kp) +Nb-xb/(x»-Kb)) B = BitRateMax/(8 and PictureRate) 

(9) 0051 

(P picture) Tp-max = MAX C and D C =Rav-max /(Np+Nb-Kp-xb/(Kb-xp)) D = BitRateMax/(8 and PictureRate) 

(10) 0052 

(B picture) Tb-max = MAX E and F E = Rav-max/(Np+Np-Kb-xp/(Kp-Kb)) F = BitRateMax/(8 and PictureRate) 

(11) 0053Ti-max of an upper type, Tp-max, and Tb-max, Namely, it is a maximum of a target assignment code amount 
in the 2nd code-quantity-control means, These values are sent to the VBR code-quantity-control machine 51, about the 
picture type concerned of said picture of the present when it codes, a limiting circuit is applied with a value of Ti-max, 
Tp-max, and Tb-max, and a target assignment code amount of the present picture determines a value of said Ti, Tp, 
and Tb. 

0054Based on a target assignment code amount determined as mentioned above and a generated code amount of 
each macroblock detected with the buffer 16, a method of MPEG 2 Test Model 5 is used, and a quantizing scale of each 
macroblock is determined. 

0055From the picture characteristic detector 25, the activity ACTcur of each macroblock is sent also to the code- 
quantity-control machine 51, Although used for adaptive-quantization control which changes a quantizing scale of each 
macroblock based on an activity in MPEG 2 Test Model 5, it is not necessary to perform this adaptive-quantization 
control. A quantizing scale of each macroblock may be determined by a completely different method from this. 
0056A quantizing scale of each macroblock outputted from the code-quantity-control machine 51 is sent to the 
quantizer 13, A mark is outputted, after variable length coding of the present picture (a divided original image after 
DCT or an error image block of motion compensation prediction) is quantized and carried out with this quantizing scale 
and it is adjusted with the buffer 16. 

0057A generated code amount supervised with a quantizing scale for every macroblock and the buffer 16 is sent to the 
normal child-ized scale detector 22 and the generated code amount detector 23, and is used for code quantity control 
of the following picture, respectively. 

0058In the upper explanation, amount Rav-max of average allocation codes of 1GOP in the CBR code-quantity-control 
machine 52 was calculated as a code amount to which it is simply assigned by 1GOP at the time of the highest transfer 
rate (BitRateMax).On the other hand, if presumed picture complexity Xk-c of a predetermined function like drawing 2 
(a) which makes a factor presumed picture complexity Xk-c (k= i, p, b) of the present picture to be coded from now on, 
for example, the present picture, increases, the value will set up the function f (Xk-c) which approaches 1 infinite. 
0059By using Rav-max' of the following formula (12) which carried out the multiplication of this function for every 
picture type instead of Rav-max, As shown in drawing 2 (b), press down gradually the generated code amount in the 
case of being close to the highest transfer rate of each picture type, and. The image quality deterioration of the picture 
type concerned produced from the relation between picture complexity and the amount of allocation codes becoming 
discontinuous at the point beyond the highest transfer rate becomes possible also pressing down the problem 
which becomes remarkable . 
0060 

Rav-max' — =f(Xk-c), (BitRateMax/PictureRate), andN — the function (k=i, p, b) (12) which shows drawing 2 (a) f (Xk- 
c) here0061The 2nd embodiment of the video coding equipment of this invention is described with drawing 3 below. In 
the 2nd embodiment, it is a case where this invention is applied to the Variable Bit Rate code quantity control of a two 
pass system. The fundamental coding portion until it is changed into a mark with an original image input - the variable- 
length-coding machine 15 is the same as that of the 1st embodiment. Since encoding operation is. performed twice (or 
more than it), temporary coding is performed first and the 2nd coding is performed based on the result of the 
generated code amount about one picture, it differs greatly that there is a portion which is different in both encoding 
operation. 

0062In the 1st coding, a quantizing scale sent to the quantizer 13 is not sent from the VBR code-quantity-control 
machine 51, but a fixed value (values, such as 6 and 8) is sent from the temporary coding quantization set scale 
machine 56 via switch SW1, and, thereby, quantization of a fixed value is performed. And a bit stream after variable 
length coding was performed in the variable-length-coding machine 15 is not sent to the buffer 16 for outputting it 
outside, but it is sent to the temporary coding generated code amount detector 53 via switch SW2, and a generated 
code amount of each picture in the 1st coding is detected. 

0063A temporary transfer rate is computed by a generated code amount being sent to the temporary transfer rate 
memory 54 from the temporary coding generated code amount detector 53 one by one, and being added for every 
prescribed period. This operation is performed until coding of one image sequence is completed, and a temporary 
transfer rate for every prescribed period is accumulated in the temporary transfer rate memory 54. 
0064After the 1st coding is completed, a temporary generated code amount or an average temporary transfer rate of 
the whole image sequence is computed, this value and a temporary transfer rate for every prescribed period are sent to 
the target transfer rate calculation machine 55, and a target transfer rate for every In the 2nd coding (actual-code- 
izing) prescribed period is computed. 

0065A relation of the temporary transfer rate Rt for every prescribed period and target transfer rate R of the 2nd 
coding in the 1st coding sets up a predetermined function beforehand. For example, the following function as shown in 
(13) can be considered. 
0066 

R=a- (Rt) (13) b (a and b are a constant, a> 0, and 0< b<l)0067The 1st temporary coding is completed, and if a 
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target transfer rate of coding which is the 2nd time is determined, the 2nd coding (actual-code-izing) will be started 
according to the target transfer rate. In the 2nd coding, a value from which a quantizing scale sent to the quantizer 13 
was obtained with the VBR code-quantity-control machine 51 is sent. 

0068A normal child-ized scale of each frame detected with the VBR code-quantity-control machine 51 here with the 
normal child-ized scale detector 22 and the generated code amount detector 23, and a generated code amount, From a 
target transfer rate for every prescribed period computed from a temporary encoded result with the target transfer rate 
calculation machine 55, a target assignment code amount of a picture to be coded from now on is calculated. 
00690n the other hand, it is inputted into the VBR code -quantity-control machine 51, a limiting circuit is applied to 
said target assignment code amount, and a target assignment code amount also determines a maximum of a target 
assignment (it can set for 2nd code-quantity-control means) code amount computed with the CBR code-quantity- 
control machine 52. A maximum of a target assignment code amount in the CBR code-quantity-control machine 52 is 
the same as that of (based on Rav-max) Ti-max in the 1st embodiment, Tp-max, and Tb-max. 
0070A quantizing scale of each macroblock is determined using a method of MPEG 2 Test Model 5 grade like the 1st 
embodiment based on a target assignment code amount determined as mentioned above and a generated code amount 
of each macroblock detected with the buffer 16. 

0071Thus, a quantizing scale of each determined macroblock is sent to the quantizer 13, and variable length coding of 
the picture (a divided original image after DCT or an error image block of motion compensation prediction) to be coded 
from now on is quantized and carried out with this quantizing scale. 

0072A mark is outputted after being adjusted by target transfer rate for every prescribed period which a bit stream 
generated here was supplied to the buffer 16 by the 2nd coding, and was computed with the target transfer rate 
calculation machine 55 here. A generated code amount supervised with a quantizing scale for every macroblock and the 
buffer 16 is sent to the normal child-ized scale detector 22 and the generated code amount detector 23, and is used for 
code quantity control of the following picture, respectively. 

0073The 3rd embodiment of video coding equipment of this invention is described with drawing 4 and drawing 5 
below. Although the above embodiments 1st and 2nd are the cases where this invention is applied to Variable Bit Rate 
code quantity control, this invention is not limited to it but broad application is possible for it Like video coding 
equipment shown in drawing 4, encoded bit streams of an output of the buffer 16 are divided into two with the stream 
separator 59. Output of one of these outputs the whole encoded bit streams which use I like drawing 5, P, and all B 
pictures, and another side outputs encoded bit streams which use only I and P picture before long. 
0074The output of only I and P picture shall be a header conversion machine which is not illustrated here, and the 
parameter of a header part, etc. shall be rewritten by the suitable value. The code-quantity-control machine 1 (51A) of 
drawing 4 controls the code amount of the whole bit stream, and the code-quantity-control machine 2 (52A) controls 
the code amount of the bit stream of only I and P picture. 

0075Here, both average bit rate shall be set up so that the amount of average allocation codes of each picture type 
may serve as a comparatively near value with the code-quantity-control machine 1 (51A) and the code-quantity-control 
machine 2 (52A). In order to satisfy the code quantity control of two bit streams simultaneously, the code amount 
quota result of I in the code-quantity-control machine 2 (52A) and P picture is sent to the code-quantity-control 
machine 1 (51A), With the code-quantity-control machine 1 (51A), to I and P picture, I as a result of the code-quantity- 
control machine 2 (52A) and code amount assignment of P picture are applied as it is, code amount assignment is 
newly performed about B picture, and control of the code-quantity-control machine 1 (51A) is realized. 
0076Thereby, by the whole bit stream, while control with the code-quantity-control machine 1 (51A) is performed, 
when I of a bit stream and P picture portion are taken out with the stream separator 59, the bit stream controlled by 
the code-quantity-control machine 2 (52A) can be obtained. 

0077When the bit stream of only I and P picture does not need to be outputted with the stream separator 59, in the 
code-quantity-control machine 1 (51A), the usual code amount assignment is performed about I, P, and B pictures of 
each, without performing code amount assignment with the code-quantity-control machine 2 (52A). When not 
performing code amount assignment with the code-quantity-control machine 2 (52A), the signal which shows it is sent 
to the stream separator 59, and an output is stopped for the bit stream of only I and P picture there. 
0078In the code-quantity-control form in which not only the embodiment of drawing 4 but this invention has two code- 
quantity-control machines, as opposed to the code-quantity-control machine 51A of a main direction — ** — by adding 
restriction by the code amount quota result for every picture type of the code-quantity-control machine 52A of a 
direction, Rationalization of code amount assignment of each picture type can be attained, or the video coding 
equipment corresponding to two decoding systems can be realized to one encoded bit streams. 



Brief Description of the Drawings 

Drawing lit is a block block diagram showing the video coding equipment of this invention, and the 1st embodiment 
of the method. 

Drawing 2It is a figure showing the relation between the function in the case of Rav-max* calculation of the 1st 
embodiment of this invention, and Xk-c and the amount of allocation codes. 

Drawing 3It is a block block diagram showing the video coding equipment of this invention, and the 2nd embodiment 
of the method. 

Drawing 4It is a block block diagram showing the video coding equipment of this invention, and the 3rd embodiment 
of the method. 

Drawing 5It is a figure showing the situation of the bit stream division by the stream division means of the 3rd 
embodiment of this invention. 
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Drawing 6It is a figure showing an example of coding picture structure. 

Drawing 7It is a figure showing the example of 1 composition of common video coding equipment. 
Drawing 8It is a figure showing the example of 1 composition of conventional video coding equipment. 
Explanations of letters or numerals 

11 Subtractor 

12 DCT device (DC to AC converter) 

13 Quantizer 

14 Code-quantity-control machine 

15 Variable-length-coding machine 

16 Buffer 

17 Inverse quantization device 

18 IDCT machine 

19 Motion-compensation-prediction machine 

20 Adding machine 

21 Frame memory 

22 Normal child-ized scale detector 

23 Generated code amount detector 

24 Picture complexity calculation machine 

25 Picture characteristic detector 

51 VBR code-quantity-control machine 

52 CBR code-quantity-control machine 
51A Code-quantity-control machine 1 
52A Code-quantity-control machine 2 

53 Temporary coding generated code amount detector 

54 Temporary transfer rate memory 

55 Target transfer rate calculation machine 

56 Temporary coding quantization set scale machine 
59 Stream separator 

The amount of average allocation codes of 1GOP in case Rav-max BitRate is the highest transfer rate (BitRateMax) 
The amount of required allocation codes of Rck 1GOP (k= i, p, b) 
SW1 and SW2 Switch 

The target assignment code amount of Tk each picture type (k= i, p, b) 

The target assignment code amount of each picture type in case Tk-max BitRate is the highest transfer rate 
(BitRateMax) (k= i, p, b) 

Picture complexity of the picture of Xk present (k= i, p, b) 

Presumed picture complexity of a picture of the Xk-c present (k= i, p, b) 



Drawing 1 

For drawings please refer to the original document. 



Drawing 6 

For drawings please refer to the original document. 



Drawing 2 

For drawings please refer to the original document. 



Drawing 3 

For drawings please refer to the original document. 



Drawing 5 

For drawings please refer to the original document. 



Drawing 4 

For drawings please refer to the original document. 
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Drawing 7 

For drawings please refer to the original document. 

Drawing 8 

For drawings please refer to the original document. 



For drawings please refer to the original document. 
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\z, w***4?\z&%^mn%<»m&\vm-oz 

[0 0 0 7] ZKDTest Model 5lCfctf.5®£tf -y h b- 

muwm Lz*>mm y st en^fc 

46. 1t»**<£fc*&tft->->fcttLTtt+#fcfc 

^•tf^^sftftcait^ktfsuTL*?. iintcw 
lt> m®m&'j>r^m&r**s->o)®£Mm^m& 

m Jic S -3 T&tktf £ DVD-V i deo©<fc o tc rI^IeS 

[0008] lX±©ct 5 %HH*<H^-r* U- h$«J?|!7J 
5£tfRl£ tf y h U- Uai8P7J5£Ta&* 0 ^M¥6- 1 4 
1 2 9 8^iifgtC«, RlSElf y h U- h»tCcfcS^ 
{bSBtflB^^tlT^So mmiCs At} 

W)W® fcti LZmfcm&tZ'r-Mc cfc o Tffi^^k^ 

A73»ii^ft©f§^^S^mgfi(c^«<fe5 

fiff^k«©584»^«te*^T#»»©aa»g 

[0 0 0 9] L*^U ±IBfiE*«yTtt, asTjeyhxh 
y-i^^^#sfcA6^c^i'>^< 2s©iaF^fk*fftoft 

T«c:©SH©J:5%2/\"X755C©RlSt:*y h U- hSJ 

[0010] ctiic^u »imi*Btfy7/u*'rz»T 

1 M°X73ie©pJ£tf'y K u- h$iJ©73^t»#?iT5o ft 
1 0-1 6457 7^iiSlC«, 1 A°7.755t©pJg 
tf y h b- K»75>4(c cfcS^{kgB^luIBiifS©0 
6mcffi/T,*nTl^ e 



lafftx^- iU«iais8 2(cMeu zwmm+it 
- h«im«ffWHmi7 4T«iLm. 

[00 12] 

hJcy^tC/J^^Jf^t*. Test Model 5<D<fc-5lcB£ 

[0 0 13] SflWdtfy KU- htf«*IS£U- hie 

U-Mc***JH*gW"*J:3»cay» B £^^-v»£<D 
M£!reft«>jtjyc||/j\ u ft(c»tl3fPn# tf * * t 
* -T £ A/£H o T t £ -5 . MSWM® 

Ptr^? + OHRtfffl»«te3R<fty. S^^fcfyh 

[0014] *ct?*5Bib(& Iljiifttt9<b&mc£i* 

[00 15] 

mm*m : &TztcisbV)5ffl mpeg2H^ 
£^st¥^s?fbX'7--/i/^ai-r«m fieti 

fcll4^Mi¥i£i§?<bX^-;U^6^lc^b-r5 
1 0lW«MW#«T*f*Sti*ty 

20fl^*iW»#a7««BlS26b- hOS^fcfy I- b 



fctJSffMtf IS 2 Oft WM0¥gt-tf95ti3MMitt 
ft^MctU *ftW^»£tt*1 

i§#tc£l^T *» . B * + tc*&Wc£ < 

[0016] $?c. ±e«niff9fttti?, 
MLzmztizmmmtrnzm^z. i/\°x73S©pr^ 

»#«7»ff6n*ii^ff*«©±iBt£*i;T»j^»*» 
©±BB**Br s c £ k <t y x $mn%m<D±mti:%.v 

[0 0 17] tfc. ±IB<DSlSi«^ffcg«^JSfflU 
7, 1 -DCDftmtZ'y hX h y-^^20(D^^T« 

flJxtfO h3.HJ-^£{*THi I . P. 
Bbf?**£TfcofdI#<Dra^<bT\ lo<D^& (i 

1 1 p t;**+(D**«^T*i& s i vn^mMwz 

&&& tfy h'J -Z*£tt<DJW«*M» U 12© 

»«»*y»#STtt i <t p tf^^+co^e-y hx h 

-Z»»»©«F«*«l»LTs i . p t;* 

^^2 oft%m®m¥mT°me>ti%%mft^ftizmm l 

[00 18] 

[5gBS<DHS60m«] *IIB§(Di)il#^^bggo^i 
cDHfig^co^T. 01 tftlciXTKfftlE-r*, sue 
^ Lfc <fc 3 *^©l!iiI«l?4Kb8«&tf-€-0!)*^ 
©«1©IIBWJ!ltts Mft£1 K DCTS1 2, M^b 
tt1 3, ^KAff#ftH1 5, /\>77'1 6, ia»*^b 

si 7, i dc ts 1 8s mzmm^msi 9. 

2 0, 7U-^f'J2K ¥i»^bX^- /UttfflS 
2 2. ££ft*»*tiJ8l2 3, iiS«^)t^ai§g2 4, 
S^1ttt^aiS2 5, V B RI^MJOff 5 KMC 
B RfmiHHMI 5 2<£ U <f«**lT^«. 
[0 0 19] Jliiii^iil^^P'y^^iiJS (H^« 

«b©tf«IH1 1 1 *^LTB«a«HK0-aT»* D C 

t»i 2tcsen. d ct-z nrcmcm*it%i 3t?s 

^l*Jtil§5l 4^S5H6tl«m^bX^-/HC<fc^TM 



[0020] zom+itt -tittrnma. mtrntmrn 

titd&tcn^&litfrttiZo -15. »?fbHi 3<Diii*i 

mm*, mm&ffl i d c ts§ 1 8 vm&iM&-& 
tits ittMrnMi 9©aiaiMiQiH§2orjo»* 

ft*c£ft<. 7P-y7SK7U-.ky : Ey 2 1 tCgfTl 
[002 1] P&tfB£9?*{C3l*T& »*J3-tlfc 

MBB7py*i«*BfltWIBi 9icflwwr*u c 

«7p -y 7 *»8 1 1 ?«B«7p y 7 £©BT?BB 
BB5M«5*u *$ra?*SKBBB7Pv7#DC 
TBI 2tc^sn^o 

[0 0 2 2] C©fcttl fcf** + £W«lcLT» DC T 
881 2T«5Mi« ? DCT*tU S7<bf§1 3Tff#«H 

[0 0 2 3] *HbS1 3©a*fl»(*. 2SM7<bg§1 
7<h I DCTIS1 8 tlfcfMc* tt$ffiflt 

msi 9fr$(Dmm?mm®Jnv?mm$52 ok 

•fcoTBBftfciOJfcrtu 7P-y7#U:7U-Zx* : Ey 
2HC|f*6tl*. £fcs *e**vfcol*T, S7fb 
Si 3fr&T*n7ny**©B*fkZ$— /WWW 
?fbXfr-/l/8HJ»2 2fc2&5*U *C?17U-,M* 
<£M7{b7*-/Utfi)0|{;**u 17U-A0¥iW7{b 

[0 0 2 4] -Tjx /^77 1 6IC£^TU« 58ft«W 
BtfEB$tU *©Bfffffi»*»8HiS2 3U:2&5ti 
-So E©B*aW«M»2 3lcfil,vr» 8£ft*f£tf 
7U-A*ffitCfiO»*nx 17U-Z*CDSg£??^mtf& 

/k ff£^wtBimaiitBii 2 4 <t c b Fm 

[0 0 2 5] -TJs B«$tttt!BS2 5?a\ »«*tl 

ACTmb= a • ACTcurH- b 

[0 0 3 2] ££t*a, b, cOflttb???* 
b = c = 0<iay. ^«£*Td7P'y7lcJfc^Tf££?3 

[0033] ciOcfcatc, ^Bt-KwcwLfcT**? 
fcBBBttKeft&ftrttica*. 

[0 0 3 4] BE*t£g|Jd382 4TH*ttiie*tlfc&7 



p7P«y7¥ffitcii«1t14«/T.-r/^P<— 5fs fftto-B 
7^7-f tf^-rtfttlB&fU 7U-/k*tttCiBll?hT 
*<0e*tfBffi^BJiajB2 4lciSStl*o 
[0 0 2 6] Tat)*, B«tttttHJ«2 5^<DAJl 

i*. i e^^+©«^tt»*«« : ?3i*i { fitoftat^c 

d&, T7 p7p y *JMftlc^J;!rftfcJiaBiBB©*tf A 
* * tu 77D7Q77 UtttcMWtt */T.r / \°5 ;>< - 
*"P**7*x-f fcfx-f ttCTcur)J^U3"*U 7U-Z» 
HflWcfllllStu I t°75 1 +CD7 7 7r'f tix^ACTiiL 
TBBttttBltiHB 2 4 lc£5tl3o 

[0 0 2 7] 7*77- 4^?- 4 (ACTcur)£LTtt»B«0 
«tt, B*M*»«a£tf#*.5*i*tf» MM«tt«^ 
rfc©T*£fttf*<&fl&0/«5*-$T*t>aiA> 

[0 0 2 8] -75x 01 lCjftrBBttttttt&B2 S'VD 
A7J«\ PStfBfcf*** »»J*ftfcH»B 
#©fftlc> 77P7n» 7iW&©»**«*»lca3W-* 

^hiW«*«flmill1 9fr6A*lUrtl*o »«* 
hfcNHHt 6 t* I t? 7 * + © IDIflCT 7 p 7 
□ v (JSB«) 77x-f t*x<ACTcur^ai?n 

So 

[0 0 2 9] ?7P7'P-y 7¥ffi<D»£«flr?3l!J 

fbB«i#88B«iO)M»B««x Tie««»S 
fc«2«HII»tf£Sl'L TO^t* Ifx-rACTpred 
<k LT8tB*ft3o *61C »*BflfMflTMWBLfcft 
$^7h/KD75«. »»T7n7P'y7£0!>BT*J8# 
Slca»OlftS4«#t5ft. ACTmvi LTttiB* *l3 0 

[0 0 3 0] ^LT, S77P7Py7Slc^S(D© 
JH^lcJ: y s ACTmbA^tB^tU ^tl*« 1 7 U-^JDS 
*nTs PSt/B^^ + ^^x-f tTx-fACTpR^AC 
Tb<b LTBS^IiJggJiJSi 2 4 ICS 6tl*o 

[003 1] 



ACTpred + c • ACTmv 



(1) 



^<bt:°7 ^ v 9 -r ute-saBMrt ©ffl^UDW;*- tifta 

lc ^0fflP^F«90^1 L: tf7 V 7 •< 7(D7 l/-l»ST«l 
JftTx =&tf7^ + 7'T7<0¥*llB®^Jt Xi-ave. X 
p-ave, Xb-ave tfgaj;*ti3 0 
[00 3 5] CC?*5-*IBBrt«, »^M)lt7L 

iSx Bit«1 5 7U-Ia^6\ 3 0 07U-Zxtt^fc 

-s©7U-z*ao«^«y, »^bBt&7u-^ 
b©»7 Lfc^fr y 0®^$ T<D<fc 5 ic, n;*7 



-UR®j§s-e«K &mtLrc7is-LM»&totc-%. -r^ACTk (k= i. P , bk mmasmtLtcmcet? 
mmmtcz%^£im%mmm$L7\s-k&& **47<mm>>wBm&m xk-p (k= i, P . w, t 

iMDLTl^Cfctca*. ^xft'x-rACTk-p (k= i.p. b)<fcyTIE<D5t(2)T*i 

[0036] cft**6ff^br «3Ka©ffi«©iiiii«Kt sttiifcSo 

JtXk-c (k= i, p. b) tt, W£Omm>T'7 : r<<\ZT [0 0 3 7] 

Xk-c= Xk-p • ACTk/ACTk-p 

(2) 

[0038] «3W««tcds^T» n ex**** <r>m^.mmmmm xi-c, xp-c, xb-c »vbr^mj«p 

mt77r-<< £r -?-n*¥^tt*iJii r-£BitRate, 1 »Mjy©7U-.k»£PictureRate, 1 

<frn«f«fel\ -7\s~Lto&*£*Zts 1G0P<D¥«D&JM^SRavett 

[0039]Sfc??***-l' 70¥£HINNtt X I -av &3 (3) 6 ft3 0 
e. Xp-ave, Xb-avei, Ctl/?5^Wfl;T*33ia©iB* [0 0 4 0] 

Rave = (BitRate/PictureRate) «N 

(3) 

[0041] ±itoRavett¥E)iiE&3iJ£OIJ$01GOP4> IM£-£lc£fc?-li£lC#g£1G0P<O#giiJ^ 
EftfrSIWfWJMKOB ft^tSRck (k= i. p. b) tt*SC(4)?4*.Sft*o 
®*^t?160P©il®^-«ltciifBiiH«*iJggaiS 2 4 [ 0 0 4 2 ] 

Rck= Rave • Xk-c/Xk-ave 

(4) 

[0 0 4 3] ±5M)Rck (k= i, p, b)*1G0P<Dfcfcf* X^-;KOlfl3£Jt**Kp, Kbif^o C©^ fcfc?** 

^+(ciS«»ctjyja*c^(c<fcys ctu^siwftt* +*<r©a«iiai»*Ti. t p , tm**3(5)(6)(7) 

Sia©H<»©ll1©»**IW»*iatcfe»t*B«»*« T4il6ti«o MAX[a, b]tta£b©l^mfr* 
*1WJ1"*. 0fl£LTMPEG2 Test Model 5<7>g*lft^S £(^££3ft?«lbfE&CT , r. Xi, Xp, XbttCC 

[0 0 4 4] 160WC#*tl*P, Btf<7**©7U-Zxlfc [0 0 4 5] 

£Np, Nb, I e***[C»T*P, Bfcf***©«?<fc 

( I tf^^-v) 

Ti= MAX[ A , B ] 

A = Rc / ( 1+Np-Xp/(Xi'Kp)+Nb'Xb/(Xi-Kb) ) 
B = BitRate / (8-PictureRate) 



(5) 



[0046] 

(PWfV) 

Tp= MAX[ C ,D ] 

C = Rc / ( Np+Nb-Kp-Xb / (Kb-Xp) ) 
D = BitRate / (8-PictureRate) 



(6) 



[0047] 

Tb= MAX[ E , F ] 

E = Rc /( Np+Np-Kb-Xp/(Kp-Kb) ) 
F = BitRate / (8-PictureRate) 

(7) 

[0 0 4 8] -f5s CBR^jUBJffllSS 2T'tt7U-Z» #©«3{r6III«C^btfet;^^ + ©lliB1«i*Xi. 



©BS©#e** + *«f7©aaWJM«rafiTi-Bax. Tp-m 

ax. ib-max%%-\ m^mftmzmzteitzammm 

ITi, Tp, IbtmmzmtoZo C£T\ 1G0P<£¥E|tiJ [0 0 4 9] 

Rav-tnax= (BitRateMax/PictureRate) 



(I fc?***) 



[0050] 

Ti-max= MAX[ A , B ] 

A = Rav-max / ( 1 +Np • Xp/(X i • Kp) +Nb ■ Xb/ (X i 
B = BitRateMax / (8-PictureRate) 



(8) 



Kb) ) 



(9) 



[005 1] 



(pt?**+) 



[005 2] 



Tp-max = MAX[ C ,0 ] 

C = Rav-max / ( Np+Nb-Kp-Xb / (Kb-Xp) ) 
0 = BitRateMax / (8-PictureRate) 



(Be?**) 

Tb-max = MAX[ E . F ] 

E = Rav-max /( Np+Np-Kb-Xp/(Kp-Kb) ) 
F = BitRateMax / (8-PictureRate) 



(10) 



(11) 



[0 0 5 3] ±5W5Ti-max, Tp-max, Tb-max^ f&fo 

^COl^T. SufiBL/cTi. Tp, Tb(DfI«Ti-max, Tp-ma 
x, Tb-max<D{lT' 'J 5 v**Mrtt 6 tu m&(DW&<Dm 

[0054] ±.0)&5\zLT2teLtcmmm®%m. 

ft^Sfc^xtlC, MPEG2 Test Model 5©*^*ffl^T# 

[0055] e*>\ ®m$&&mu2 s»6MHm 

©85 1 ^t&7?P7p«y?<&7'?X'f fefx-rACTcur 
tfSStu MPEG2 Test Model 5lC*>ltS7?x-f If x-f 
icS^TS?? O 7 P -y ^CDM^kX^-^^SMr 

P?P «y tVAfttZt—lb&itoZ. LT t. <fct\ 
[0 0 5 6] 1 tfStMjStiSfcT^P 

£©Ii®(D C TJ^!>^J$n/diaHft£fe(itt$*lflt 



[00 5 7] ??p7a-y?§©fi ; ffbx^-;k /to 
771 eT^ttsnsRS^mtf^nftu ¥*dm? 

[0 0 5 8] JM5, ±©»KIJTW\ CBMWWJWII5 2 
JCiJlt*1G0P©¥^SiJ^^^aRav-fflax*, St&lcftHi 
h (BitRateMax)(D^lC1G0Plc|iJ^T6tl5?9^ 
S£LTWtlLTWco Ctllc&LT* Ctlfrbft^b 
rSBSOMtOfflamttXIr-c (k= i,p, b)£ 
H»tr*v 02 (a)©J:3»W*©H», flliltf. if 
a©Bfl«0J6«BiB^fiXk-ctf«|*r*i:*(0fiitflB 

y*< 1 jcifi#<iistf (xk-c)*Ksr* 0 
[0059] e^?+*-r^»tcc©BB»4sutLfe* 

3 (12) ORav-max' £Rav-maxtf)tt U (CttJ§? S C 4: <fe 
y, El2(b)tC,Tx*tlS<fc-5lC, §tf??-V^'T7°0« 

tftte, *X1^U-h«ja*fc£?Siiffi^£»J!!; 

* * * -f 7©ER*fbtf H3teaap,aH«f *.* c 1 1 

[0060] 



Rav-max' = f (Xk-c) • (BitRateMax/PictureRate) • N 
dCT'f (Xk-c)ttH 2(a) (c^rHft (k=i, p. b) 



(12) 



' 1 /TN 



[0 0 6 2] ISgCDU^bT^ l?ft|1 3lCg£ 
4— /MB£II 5 6 ^S-SflMK 6 £fr 8 £ l^ofc«)# 

Ri*ftiWfb« 1 5 icfc^TRi^g^^k^Ttonfe^ 

77 1 6lciM5ti?\ X<'y^SW2^UTifi^k^ 
£^MtffillS 3 KSStlT. 1 SJgdD^klcjfeW" 

R = a • (Rt)b 



[0 0 6 7] IHlflDfilMflaMlTU 2SB©ff^ 

ffioT2EIB(JMf^fb(SI»^k)tflBJ&*ft*. 20B 
©ft^fkTHi, M^kSli 3tc^eti5M?<kX^- ;U 

[0 0 6 8] VBR$9ftl&IMg5 1 T«> 

/U«WH2 2* ££ft^S&{iJSS2 3T-8 

[0 0 6 9] -15. am^mmms 2Tmm^ntc 

^vBRff^MiMis 1 icAjjftu ttesmysm 
*k g = «y *ftw*s*u aawjaff^** as *. 

CBR^^M»S 5 2 (C£l*«Sam]£itt9S0)±IBfi 
SN&StJfUWlCiJW'S (Rav-maxlCcfe'S) Ti-max, Tp-tna 
x, Tb-tnax<k|f]— T'££o 

[0 0 7 0] tt±©J:5tcLTa*LfcB«il^»*« 
Ay7?1 6T*«ajSft3&-7*P7P'y*<&38£ 
»1 ©St«fl£H«lCI»PEG2 Test Mod 
el 5H©*>i^ffl^TS^"5'P7P > y^©m^kX'7-- 

[007 1] £©<fc3lcLT*jea-*lfc*T*Q7Q'y 
-7©S^kX>r-;U^S?<kSl 3|C£6tU Cftfr6 

[0 0 7 2] CCT»4-r*fcT*y KXh'J-Zktts 20 



[0 0 6 3] 98£lfflttM*fam&£IW«ttll 
S5 36^6i5l£SU-h^ : Ey5 4tc^6n. msffliB 

*u (Sfes u- h y * 'j 5 4 (caffisfflnsa&isg u 
[0 0 6 4] isB©i?^bWS7-r*£» h»->-* 

StU C <Dfil£ffi£mnft4>tia&£ U- h IMS* U 

- h mass 5 5 teg en. 2 0 § ©ft^k (n^^b) k 

[0 0 6 5] 1 Sg(D^bfcJJlt*fiFrJtKSIIBS 
[0066] 



( a. bteSS. a>0, 0<b<1 ) 



(13) 



a u- hums 5 5?*tiif tifcmsinneosansss 

p^Py^SOM^kX^— ;k /?77?1 6 T'Kffi? 
2 2, 8£ff#«*tfill2 3ttK6tU 
[0 0 7 3] MIC, *9ffl4)lbMOT«{bltBa>ft34> 

±<dh 1 Tkxfm2<DmmntPim\Z'y h u- h^s*j 
»tc*aw*5iffl Lfc^T^§6\ *w8ii*fticH 

■MraftSB4>J:3(c« /(777 1 6(DtB73<D^k 
k'y^XMJ h y -Zx^fJS 5 9 T 2 olc^lt 

T*«fl!Lfcft^kfcf'y hxhy-z*^t^ai73U t 

[0 0 7 4] I, P^^VCO^liitHt. 

^^M$iJffllS 1 (5 1 A) tttf-y h 

*«**]» U ^fi»J©SI2 (5 2A) ttltP^ 

[0 0 7 5] CCT-x ffWBWHIl (5 1 A) 
S»S2 (5 2 A) ?&£<7?+*'C70y-mi%® 

g2 (5 2 A) fcfclt* I . PbT^^^OfaFmi^lS 

ffl -fc«:S-B-*<i»naH 1 /'CI A A l-^dll «rS-HHtll«W3H 1 



(5 1 A) Vit I . Pe***lco^T(4»M6yWS 
2 (5 2 A) ©»»©I.Pt:** + ©lWBWi||** 

»9S«HMI1 (5 1 A) ©«!&«££? 

[0 0 7 6] ctucj: y tfv h v-h-ZteTi&zm 
BM0B1 (5 1 A) lcJ:*M»jtM5;foft*£BBfc» 
X h U - Z*»iJ8 5 9 Ttf-y h 7. h 'J -Z*© I . P tr ? 
*+»»*ByffiLfcB^ff«tt8BS2 (5 2 A) 
TMBStifcfcfy h y C£#Hi*S, 

[0 0 7 7] &&\ 3. h U-A«l»5 9T* I <£ P fcf^ 



^S$JHS2 (5 2 A) KJcSft^SfiJ^ifrb 
tie. ff^SAHHIl (5 1 A) iCfcl^T. I, P, B 

B&JBB2 (5 2 A) tcJ:«»#«#ja»fT!taftt^ 

C"? I £Pfcf**+©*©£v h7.HJ-Z*£ffi7J£it 
#3o 

[0078] u4amms.m$Ts *mm*2?o>n 
^mmmztitztt^wmmmtt^Ts ire** 

OIHIMHS 1 AlcfcfLT. fae««*OffWHM 
IS 5 2 A ©£ fcf* * * * 4 7$0>&?SgiJM*££(C «fc o 
T*IB*iHia.*C£fc<fc-3Ts *tr**+ *<?©*» 

h y lt 2 -D©a^tc»(6 urc. mmmm 

[0079] 

BaMBff#B*B£r«Biaff#Bnwft&« * 

1 ©ff*BBM!to^Bn!!HcBR&jtoa.3m2© 
»9BM»#B**U 0J*tf qJ£tf*y h U- hflJffli© 

an, B2©»*BWBWPttB»BBi'-h©fij£i? 
^si*. »i©»*B*jB#«?Bs*i*«MHWBff 

*bjiu *ft^©«£ttBi©»*B*i»«?» 
[0080] ^rc. 1 lixjs&amMZ v b u- h*JB 

J6©BflF*ttLTB6ft*BB«B**Bt N fc*l»Sff 

sffi«BS£a»£*<5ms£©BS*sj£u 
z<om&zmwm 2 ©ff*B*jB#B?»6n*«Mi 



tc<fc y . «3^B©±BtcifilM»#fca3W-*»*B© 

«**a>iwr*£8te» «i!j*ff*B©±H*Ba.fcjsn» 
[0 08 1] sre, ±£©BBBff9<k£B&££L 

T> 1 -DOnmtZv hXb'J 2 0©«^&T*ft 

z$mm.$miz&?zn 1 ©»ww»#B©»*Bi] 
s*#JPfi-rsc tic j: y. 1 o©^b^BT2 o©a 
*s«cas^Ta*Rri6*»^b*ff3 c £ agists: 
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